(19) 



J 



(12) 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP 0 982 943 A2 

EUROPEAN PATENT APPLICATION 



(4d) 


Date of publication: 


(51) 


i j. y-»i 7 UA/I M 7/AQ 1 in ^ \ | ~7//~\00 

Int. CI/: M04N 7/08, HU4N //Uoo, 




01.0o.2000 Bulletin 2000/09 


H04N 7/52, H04N 7/173 


\£- 1 ) 


Mppncaiion numoer. yy i^^ozo.y 






(22) 


Date of filina - 07 03 1997 

l—/ C4. Lv^ w 1 Mill 1 V_J . w f ■ V W ■ 1 -J -J F 






(84) 


Designated Contracting States: 


(72) 


Inventors: 




AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 




Hidary, Jack D. 




mi px <^F 

liL r 1 O L 




New York,NY 10016 (US) 




Designated Extension States: 




Ullman, Craig 




a i i x i \i or\ ci 
AL LI LV KlJ ol 




Brooklyn,NY 11203 (US) 








Spivack, Nova T. 


(30) 


Priority: 08.03.1996 US 613144 




New York, NY 10016 (US) 




14.03.1996 US 615143 






25.03.1996 US 622474 


(74) 


Representative: 








Needle, Jacqueline 


(62) 


Document number(s) of the earlier application(s) in 




W.H. BECK, GREENER & CO 




accordance with Art. 76 EPC: 




7 Stone Buildings 




97908915.8/0 885 525 




Lincoln's Inn 


(71) 






London WC2A 3SZ (GB) 


Applicants: 




• 


ACTV, INC. 


Remarks: 




New York, NY 10020 (US) 




This application was filed on 13 - 1 1 - 1999 as a 


• 


Earth Web, Inc. 




divisional application to the application mentioned 




New York, NY 10016 (US) 




under INID code 62. 



CM 
< 
CO 

o> 

CM 
00 

o> 



(54) An intergrated interactive video and internet system 



(57) A system for integrating video programming 
with the vast information resources of the Internet (20). 
A computer-based system (16, 114) receives a video 
program and uniform resource locators (URLs). The 
URLs are interpreted by the system (12) to direct the 
system to the Web site locations to retrieve related Web 
pages (98). The video program signal can be displayed 
on a video window on a conventional personal computer 



screen (18). The actual retrieved Web pages can be 
time stamped and displayed, on another portion of the 
display screen (18), when predetermined related video 
content is displayed in the video window. The computer- 
based system can receive the URLs directly through an 
Internet connection (94), at times specified by TV 
broadcasters in advance. 
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Description 

[0001 ] This application is a continuation-in-part of U.S. 

Application Serial No. , filed 

March 14, 1996, entitled "AN INTEGRATED INTERAC- 5 
TIVE VIDEO AND INTERNET SYSTEM" (Attorney 
Docket No. 4247), which is a continuation-in-part of U.S. 

Application Serial No. , filed 

March 8, 1996, entitled "AN INTEGRATED INTERAC- 
TIVE VIDEO AND INTERNET SYSTEM" (Attorney w 
Docket No. 4246). 

BACKGROUND OF THE INVENTION 

[0002] Today, the capabilities of computers to provide 15 
massive amounts of educational and entertainment 
information has exploded with the Internet. The Internet 
has the power to transform society through unprece- 
dented levels of information flow between members. 
Currently, on-line systems offer a variety of different 20 
services to users, including news feeds, electronic data- 
bases (either searchable by the user directly on the on- 
line system, or downloadable to the user's own compu- 
ter), private message services, electronic newsletters, 
real time games for play by several users at the same 25 
time, and job placement services, to name a few. How- 
ever, today, most on-line communications occur merely 
through text. This currently stands in great contrast to 
the audio/visual presentation of the alternative elec- 
tronic medium, television. However, it is expected that 30 
as multi-media's incessant growth continues, audio/vis- 
ual programs will proliferate and text will become less 
and less dominant in the on-line environment. Even 
though these programs will be introduced, the Internet, 
will remain essentially user unfriendly due to its very 35 
massiveness, organization, and randomness. Simply 
stated, there is no order or direction in the Internet. Spe- 
cific pieces of information are many times hard to find, 
and harder yet, is the ability to put that piece of informa- 
tion into a meaningful context. 40 
[0003] Television, on the other hand, has been criti- 
cized for being a passive medium - "chewing gum for 
the eyes," as Fred Allen once observed. Television has 
always been something you watched, not something 
you do. Many social critics believe that the passivity tel- 45 
evision depends on has seeped into our entire culture, 
turning a nation of citizens into a nation of viewers. 
While interactive television systems have increased the 
level of user interaction, and thus, provided greater 
learning and entertainment opportunities, vast informa- 50 
tion resources such as databases are inaccessible from 
such a medium. 

[0004] What is needed is a means to close the gap 
between video programming and the information super- 
highway of the Internet. What is needed is a wider, 55 
richer experience integrating audio/visual and textual 
database elements into an organized unique interactive, 
educational, entertainment experience. Currently, the 



2 

Internet is a repository of information on virtually any 
subject. However, what is needed is a mechanism for 
combining the user-friendly visual experience of televi- 
sion with the vast information resources of the Internet. 

SUMMARY OF THE INVENTION 

[0005] The system of the present invention combines 
broadcast television programming and/or video pro- 
gramming which appears on a VHS or Beta tape, CD- 
ROM, DVD or other medium, or video programming at a 
video server (hereinafter "video programming") with the 
massive Internet, creating a new and powerful educa- 
tional and entertainment medium. The system allows 
consumers to receive more information in a more effi- 
cient manner than either television or the Internet alone. 
Consumers not only can see a news report on televi- 
sion, but they can also read pertinent information about 
the report, as well as explore related information about 
the story. The program becomes the introduction to a 
particular subject, rather than the entire subject itself. 
The act of viewing a program has now become a more 
engaging, enriching experience. 

[0006] The system can also create a more intimate 
relationship between the viewer and the program. The 
user might be solving problems or performing virtual 
experiments on the Internet site that a teacher is dis- 
cussing in an educational television program. Similarly, 
the consumer might be solving problems that the fic- 
tional characters in a television program must solve. In 
both cases, the consumer is an active participant in the 
process, rather than a passive observer. 
[0007] Instead of an undirected and unfocused explo- 
ration of Internet sites, by synching specific Internet 
pages to the video signal, the system puts the Internet 
in context. The television program producers now can 
decide what additional information to offer their audi- 
ence. This material can now be seen in the context of 
the television program. 

[0008] An additional advantage is that consumers 
don't have to search through the literally hundreds of 
millions of pages on the Internet to find appropriate 
material. The material has already been filtered by the 
program producers and delivered to the consumer auto- 
matically. 

[0009] Another advantage of the system is that it 
changes the nature of advertising. Since additional 
information can be given to consumers automatically, 
advertising can now be more substantive, allowing cus- 
tomers to make more informed choices. Now, the act of 
purchasing a product seen on television can be stream- 
lined - the consumer can be given the choice of buying 
the product instantly using the two-way capabilities of 
the system. 

[0010] In addition, users can take advantage of the 
two-way capabilities of the Internet to respond to polls, 
to send e-mail or to link to additional sites. For example, 
a viewer watching a television news program, through 
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the system of the invention, can receive a stream of 
Web pages which provide additional, specific informa- 
tion relating to the news content -- whether background 
on the Presidential primaries or the latest change in 
interest rates. 

[0011] The video programming and corresponding 
Internet pages can be viewed on personal computers 
equipped with a television card, but the open software- 
based approach enables anyone with a television set 
and JAVA enables PC to experience the system of the 
invention. 

[0012] By marrying the appeal of television with the 
two-way data transfer capabilities of the Internet, the 
system creates a powerful new medium: Television pro- 
ducers and Internet site creators can enhance their con- 
tent to extend their brand identity and differentiate their 
program offerings to the millions of people who are 
spending more time navigating through the resources of 
the World Wide Web rather than watching television; 
advertisers can speak more directly to consumers by 
directly sending Web pages to the consumer instead of 
only displaying Web addresses in their commercials; 
and consumers can gain a new level of interest and 
interactivity over a video-based medium. In addition to 
providing significant and immediate benefits to broad- 
casters and advertisers, the system will also present 
educational programmers with away to more effectively 
use Internet resources in the classroom. 
[0013] Recently, several media companies have 
joined to create a system for linking the Internet and tel- 
evision on the personal computer, called "Intercast." In 
this system, content will be provided simultaneously 
with the TV video signal. This system, however, requires 
that stripped down Web pages be sent in the vertical 
blanking interval (VBI) of the video signal, using up to 
three scan lines limiting effective bandwidth to approxi- 
mately 28.8 kbps. This approach, however, requires 
specialized hardware to both insert the Web pages into 
the VBI and extract these codes at each PC since it 
takes up to three scan lines of the VBI. Thus, the com- 
plexity and cost of the PC is increased. Because the 
Web pages are transmitted with the video signal, the 
Intercast system is not a true "two-way" system, but 
merely a one-way "piggyback" system. In addition, the 
Intercast is an analog video product, and thus, cannot 
handle digital video data. 

[0014] The system of the present invention, on the 
other hand, is a much more flexible, but less complex, 
system. The present invention supports either analog or 
digital television broadcasts without broadcasters or 
end-users having to alter their existing systems, thus 
enabling broadcasters to reach a wide audience within 
a short time. 

[0015] In a first embodiment the actual Web pages are 
not forced into the very limited bandwidth of the vertical 
blanking interval (VBI). Instead, merely eight fields of 
line 21 of the VBI are used to deliver the relevant Inter- 
net Web page addresses to the PC. These addresses 



are called "uniform resource locators" (URLs). The sys- 
tem then directs the particular Web browser to retrieve 
the identified Web pages from the Internet. Upon receipt 
of the particular Web page(s), the system syncs the 

5 Web page(s) to the video signal, and at the appropriate 
times, presents the Web pages on one portion of the 
computer screen with the television video signal, shown 
in a window on another portion of the screen, and thus, 
provides the synergistic Internet and television experi- 

10 ence. One of the advantages of the system of the 
present invention is that no specialized chip set need be 
produced and implemented into the standard PC. Thus, 
complexity is kept to a minimum. 

[0016] In another preferred embodiment of the 

15 present invention, the VBI is not used to transmit the 
URLs to the user. In this alternative embodiment, mem- 
ber broadcasters enter the Internet through a member 
account, and will be provided with a graphical user inter- 
face for pre-scheduling Internet addresses, or URLs, for 

20 transmission to users at particular times of day. This 
interface could also be used to transmit real time live 
transmissions of URLs to users at the same time as a 
broadcast. The URLs are stored in a "Link File" for later 
transmission over the Internet to the user at the broad- 

25 casters entered time, which corresponds to the broad- 
cast time of an associated program. This embodiment 
eliminates the need to place the URLs in the VBI, and 
also allows the broadcaster to store more than one Link 
File for transmission to users in different time zones, for 

30 example. Further, more than one broadcaster could 
access the same master schedule if desired, and add or 
delete certain URLs to personalize the program for their 
local audiences. Also, personalization can be taken to 
the single user, or small group of users, by having the 

35 system send a different stream of URLs to each user, 
depending on a unique user profile, for example. Thus, 
the personalization feature of the present invention 
allows each user to receive information uniquely rele- 
vant to their interests, demographics, history, etc. This 

40 embodiment makes the transmission of URLs to the 
user even less complex than the first embodiment dis- 
closed herein. 

[0017] Thus, it is an object of the present invention to 
provide order and direction to the Internet by using tele- 
45 vision signals to place, orient and control such informa- 
tion in a meaningful context. 

[0018] It is an object of the present invention to create 
a more intimate relationship between the viewer and the 
program by enriching the learning experience through 
50 the provision of more in-depth information. 

DESCRIPTION OF THE DRAWINGS 

[0019] 

55 

Figure 1 is a diagram of the system design, show- 
ing the receipt and decoding of video signals at the 
subscriber location using the method of the present 
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invention. 

Figure 2 is a diagram showing an alternative sys- 
tem embodiment to achieve the integration of the 
Internet information with the video content by 
decoding the uniform resource locators at a server 
site and then transmitting the URLs to the sub- 
scriber stations via the Internet. 
Figure 3 is a flow diagram of the basic software 
design of the present invention. 
Figure 4 is a diagram showing another preferred 
system embodiment to achieve the direct transmis- 
sion of URLs over the Internet to the user at a 
broadcaster's entered time without encoding the 
URLS into the VBI. 

PREFERRED EMBODIMENT 

[0020] The system of the present invention combines 
the rich visual capabilities of television with the vast 
resources of the Internet. As shown in Figure 1, a pre- 
ferred embodiment of the invention is a computer based 
system for receiving a video program along with embed- 
ded uniform resource locators (URLs)-which direct the 
user's computer 16 to address locations, or Web sites, 
on the Internet 20 to retrieve related Web pages. These 
Web pages correspond to the video presentation. The 
particular video programming can be delivered in ana- 
log, digital or digitally compressed formats (e.g., 
MPEG2) via any transmission means, including satel- 
lite, cable, wire, or television broadcast. 
[0021 ] The video programming is preferably created at 
a centralized location, i.e., content creation 4 as shown 
in Figure 1 , for distribution to subscribers in their homes, 
for example. Program creation is accomplished accord- 
ing to any conventional means known in the art. After a 
video program is created, uniform resource locators are 
embedded, in one preferred embodiment, into the verti- 
cal blank interval of the video programming by the URL 
encoder 8, shown in Figure 1. In this embodiment, the 
URLs are encoded onto eight fields of line 21 of the VBI. 
Line 21 is the line associated with close captioning, 
among other things. However, the URLs could also be 
embedded in other fields of the VBI, in the horizontal 
portion of the video, as part of the audio channel, or in 
any subcarrier to the video. Preferably, the URLs have 
associated time stamps which indicate to the subscriber 
stations when, during the video program, to display the 
particular Web pages addressed by the URLS. 
[0022] The particular information in line 21 is not part 
of the visual part of the program, and thus, is not per- 
ceptible to the human eye, thereby making it ideal to 
send data information to the users. While the bandwidth 
capacity of line 21 is limited, because the system of the 
present invention transmits only the uniform resource 
locators (URLs), and not full Web pages, there is more 
than enough capacity. Furthermore, no additional hard- 
ware is necessary at the PC 16 to implement the ele- 
ments of the present invention. Thus, the present 



invention has the additional advantages of being very 
efficient and takes advantage of conventional hardware. 
[0023] Once the video program is created, it can be 
transmitted to user sites over any transmission means, 

5 including broadcast, cable, satellite, or Internet and may 
reside on video servers. Furthermore, the video pro- 
gram, with embedded URLs, can be encoded on a VHS 
or Beta tape, DVD or other medium. 
[0024] Preferably, each receiver station comprises any 

10 Intel x86 machine (preferably a 486 processor, pentium 
processor, etc.), an Apple Computer, UNIX or any other 
type of standard computer workstation. The local PC 16 
is preferably connected to either a cable and/or broad- 
cast television connection or to a local VCR or other 

15 video source. At each subscriber site, the local personal 
computer 1 6 preferably receives the cable transmission 
by cable connection on the back of the personal compu- 
ter 16. The video/audio program can then be processed 
for display on the computer screen using any conven- 

20 tional PC card capable of displaying NTSC signals on a 
computer monitor, such as a WinTV card. In addition to 
the cable connection, however, in the present invention 
there is also an Internet 20 connection created concur- 
rently with the cable connection. 

25 [0025] The Internet 20 connection can be via high- 
speed line, RF, conventional modem or by way of two- 
way cable carrying the video programming. The local 
PC 1 6 has Internet access via any of the current ASCII 
software mechanisms. In a preferred embodiment, at 

30 each subscriber home, an associated local URL 
decoder 12 receives the cable video television program, 
as shown in Figure 1. The local URL decoder 12 
extracts the URLs, preferably embedded in the vertical 
blanking interval, with the use of any conventional VBI 

35 decoder device. The URL decoder 12 may be either a 
stand-alone unit or a card which is implemented into the 
personal computer 16. 

[0026] In another preferred embodiment shown in Fig- 
ure 2, the uniform resource locators (URLs) are 

40 encoded into the video in the same manner as 
described above. Again, the URLs are preferably 
encoded onto eight fields of line 21 of the VBI. However, 
the URL decoder 24 is located at the server site, as 
opposed to the subscriber location. When the decoder 

45 24 receives the video program signal, it strips out the 
URL codes on line 21 of the VBI and delivers these 
codes independently to an Internet server 28. The URL 
code is then subsequently delivered over the Internet 20 
to the user PC 16. Simultaneously, the video is broad- 

50 cast over conventional broadcast or cable transmission 
means 36 to the user's personal computer 16. 
[0027] Another preferred embodiment of the system, 
shown in Figure 4, does not depend on, or even use, the 
VBI. In this preferred embodiment, the system will run 

55 an online service over the Internet 20. This service will 
be in the form of an Internet Web site 62 that provides a 
user-interface to a database 78 and to one or more 
associated data servers 90. The service will provide 
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member-accounts to TV broadcasters 66 who sign up to 
use the system of the invention in conjunction with their 
broadcasts. Each member broadcaster will enter the 
service at their computer 70 through Web browser soft- 
ware 74 using their member account by entering vari- 
ous identification and password information. Once 
within their account, the member will be provided with a 
graphical user interface for pre-scheduling URLs for 
transmission to users 1 1 8 over a direct Internet connec- 
tion 94 at particular times of day. The same user inter- 
face, or a variation on it, can be used by broadcasters 
for live transmission 82 of URLs to users at the same 
time as a broadcast 86. 

[0028] For example, one example of this interface 
might be a scheduling calendar (daily, weekly, monthly, 
yearly) in which the broadcaster 66 may allocate time 
periods which coincide with their broadcasts 86, and 
during which they will send out URLs to their users to 
link to Web pages. For each time period (for example, a 
particular hour long period during the day) determined 
by the broadcaster 66 to be a broadcast period (a 
period during which they want to transmit URLs that cor- 
respond to a television show being broadcast from their 
TV broadcast facility 110 to the external TV 1 14 of the 
user 118 at that time), the broadcaster 66 may then 
enter a series of URLs into an associated file ("Link 
File") for transmission over the Internet 20 at that time. 
This Link File might have a user interface such as a 
spreadsheet, table, or list, or it could be simply a tab- 
delimited or paragraph-delimited text-file. As an exam- 
ple, each of the records in the Link File consists of a 
data structure which could contain information such as: 

( < timecode ) , < URL> , < label or title > , < additional 
information > , < additional information ),...) 

[0029] The above data structure is just one example. 
The records in the Link File preferably specify the time, 
Internet address (i.e. URL), label (such as an associ- 
ated name), and some optional additional information, 
for each Web page the broadcaster 66 desires to launch 
during a show. 

[0030] When a broadcaster 66 modifies their calendar 
and/or the Link File associated with any given time 
period(s) in their calendar, this information is saved into 
the database 78 that is attached to the site 62. Each 
broadcaster 66 may maintain multiple calendars in the 
database 78 if they broadcast in different time zones, for 
example. 

[0031] The database 78 provides the Link File records 
for upcoming time periods to a server 90, which may be 
one server or a distributed network of server programs 
on multiple computers across the network, to be utilized 
for scaling to large national or global audiences. The 
server 90 provides the Link File records, including the 
URLs, to the user's personal computer 16, which is con- 
nected via a network. Examples of possible networks 
include the public Internet 94, a direct private network, 



or even a wireless network. 

[0032] One feature of the above embodiment is that 
one or more broadcasters 66 may utilize the same 
schedule in the database 78 for their own broadcasts 86 

5 or during the same broadcast. For example, a network 
broadcaster may develop a master schedule and vari- 
ous affiliate broadcasters may subscribe to that sched- 
ule or copy it (in the database) and add or delete 
specific URLs in the schedule for their local audiences 

10 or unique programming. This scheme enables affiliates 
to insert URLs for local advertisers or local subjects into 
a sequence of more general U RLs provided by their net- 
work broadcaster 66. In other words, the affiliate can 
add links that ride on the network feed and then redis- 

15 tribute it to their local audiences. 

[0033] The above embodiment can also enable per- 
sonalization in the form of unique series of URLs spe- 
cific to each user's unique profile, which is directly sent 
over the Internet 20 to each user's specific client soft- 

20 ware 106. This can be achieved from the broadcaster 
66 to each individual user 118, or to particular collec- 
tions of users. To accomplish personalization, the serv- 
ice may send a different stream of URLs to each user's 
client software program 106. The stream of URLs sent 

25 would depend on a user profile stored in the database 
78 or the client software program 106, a user profile 
which is built on demand or over time for each user 1 1 8 
based on criteria such as the location of the user, 
choices the user makes while using a client software 

30 program 1 06, or choices the broadcaster 66 makes dur- 
ing a broadcast 86, or automatic choices made by an 
algorithm (such as a filter) residing on the service 62. 
Personalization enables each user to receive URLs 
which are uniquely relevant to their interests, demo- 

35 graphics, history, or behavior in the system. 

System Operation 

[0034] Once the URLS have reached the personal 

40 computer 16, system operation is similar for all of the 
embodiments diagramed in Figures 1 , 2, and 4. 
[0035] In a preferred embodiment, a JAVA enabled 
browser 98 as well as specialized software 106 for per- 
forming part of the method of the present invention are 

45 installed on the computer 16. The JAVA enabled 
browser 98 allows the computer 16 to retrieve the Web 
pages 1 02 and is preferred software, since it is platform 
independent, and thus, enables efficient and flexible 
transfer of programs, images, etc., over the Internet 20. 

so The specialized interface software 106 (hereinafter, "cli- 
ent software"), attached as Appendix A, acts as an inter- 
face between the video programming and the Internet 
functions of the present invention. The client software 
106 retrieves URLs from the video program (embodi- 

55 ment of Figure 1) or directly from the Internet connec- 
tion (embodiments of Figures 2 and 4), interprets these 
URLs and directs the JAVA enabled browser 98 to 
retrieve the particular relevant Web pages 1 02, and syn- 
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chronizes the retrieved Web pages to the video content 
for display on the user's computer 16, as shown in Fig- 
ures 3 and 4 and explained in more detail below. 
[0036] In a preferred method, the URLs are encoded 
and embedded into the video signal by inserting them 
into the vertical blanking interval (VBI), as mentioned 
above. 

[0037] In another preferred embodiment, the URLs 
are entered by member TV broadcasters 66 along with 
specified times for transmitting the URLs to the user. At 
the appropriate times, the URLs are sent directly over 
the Internet to the user's PC 16 via the client software 
106 over a direct point-to-point or multicasting connec- 
tion. 

[0038] One method of the present invention has the 
capability to detect identical URLs sent directly after one 
another which causes the browser not to fetch URLs in 
these particular cases. As shown in Figure 3, once the 
URL code is received at the computer, the client soft- 
ware 1 06 first interprets the URL and determines in step 
42 whether the particular URL has been received previ- 
ously. If it has already been received, the next received 
URL is interpreted for determination of prior receipt. If 
the particular URL has not been detected before, the 
software checks for misspelling in step 46 and any other 
errors, and if errors exist, corrects these particular 
errors. Once again, it is determined whether the URL 
has been previously detected. If it has, the next URL is 
accessed in step 38. If the URL has not been detected, 
the specific URL is added to the URL list in step 54. The 
specific URL is then sent to the Web browser, preferably 
a JAVA enabled browser 98. Upon receipt of the URL, 
the browser 98, in step 58, will access the Web site 
address 122 (Figure 4) indicated by the URL and 
retrieve the cited Web page(s) 102 via the Internet. 
[0039] Viewers can view the integrated presentation in 
the following manner. As mentioned above, the video 
signal is processed and displayed on a video window on 
the PC screen using a WinTV card, for example. The 
corresponding audio is forwarded to the audio card and 
sent to the PC speakers. 

[0040] The actual retrieved Web pages 102, refer- 
enced by the URL, are optionally time stamped to be 
displayed on the computer screen when predetermined 
related video content is displayed in the video window, 
thus, enlightening and enhancing the video presenta- 
tion by providing in-depth information related to the 
video content thereto. Another section on the screen is 
also preferably used to represent an operational control 
panel. This control panel provides a list of the URLs that 
have been broadcast and correspondingly received by 
the computer 16. This control panel is updated to add a 
URL code each time a new URL code is received by the 
PC 16. This list gives the subscriber the flexibility to go 
back and retrieve particularly informative or interesting 
Web pages that have already been displayed earlier in 
the program, or alternatively, to print them out for future 
reference. Furthermore, the list could include URLs 



referring to Web pages not displayed with the broadcast 
program, but that provide further information on a cer- 
tain topic of interest to the viewer. 
[0041] The present invention can best be understood 

5 with reference to an example. A viewer can begin 
watching a musical video featuring a new band, for 
example. As the video is received by the PC 16, URLs 
are either being extracted from the vertical blanking 
interval or are being received directly via the Internet 20, 

w and are being interpreted by the client software 106. 
Upon direction and command, the JAVA enabled 
browser 98 retrieves particular Web pages 102 from 
Internet 20 Web sites identified in the URLs. These Web 
pages 1 02 will then be displayed on the video screen at 

15 particular times. Thus, for example, while the viewer is 
watching the music video, biographical information on 
the band can also be displayed adjacently to the video 
window. Web pages 102 could also include an upcom- 
ing concert schedule, or even audio clips of the band's 

20 music may be downloaded from the Internet 20. As 
another example, a user could be watching a program 
relating to financial news. While the narrator is shown 
discussing high tech stocks, Web pages corresponding 
to detailed financial performance information on high 

25 tech stocks, environment and characteristics can be dis- 
played with the video on the computer screen. When the 
program narrator switches to a discussion on the weekly 
performance of the Dow Jones, Web pages presenting 
related financial performance information can be simul- 

30 taneously displayed. Thus, it is evident that the present 
invention profoundly enriches the viewing and learning 
experience. 

[0042] It is understood that there can exist alternative 
embodiments for use with the present invention. For 

35 example, the user can view the interactive program 
using a television set 114 or other display monitor in 
conjunction with the display screen of the personal com- 
puter 16. In this embodiment, the relevant Web pages 
are shown on the personal computer 1 6 while the video 

40 program is displayed on the television monitor 114. In 
this alternative embodiment, a cable set top box 
receives the television program from the multichannel 
cable. The personal computer 16 also receives the 
video program from the multi-channel cable and 

45 extracts the URLs, embedded in the vertical blanking 
interval of the video signal or directly transmitted 94 
over the Internet 20. The client software 106 extracts 
the URLs and retrieves the particular Web pages as 
described above. The Web pages are then synchro- 

50 nized with the particular video frames and presented to 
the user. It is understood that a hyperlink may exist on 
the Web site that will allow the user to automatically load 
the client software and call up the specific television 
channel referenced in the Web site. For example, some- 

55 one browsing the Internet 20 may come upon a major 
television network's Web site. They scroll to an interest- 
ing story then click on an hyperlink to turn on the soft- 
ware which tunes the TV window to the network to 
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enhance the information residing at the Web site. 
[0043] Furthermore, instead of receiving the video 
program from a transmission means, the video program 
can be addressed directly from the user site if the video 
program, with embedded URLs, is stored on a VHS, 5 
Beta, DVD or other medium. In this embodiment, the 
user PC 16 and/or television 114 are connected to a 
VCR, DVD player or other appropriate device. 
[0044] Using the foregoing embodiments, methods 
and processes, the system of the present invention ere- 10 
ates a synergistic experience combining the vast 
resources of the Internet with the presentation capabili- 
ties of television. 

Claims 15 

1. A system for presenting integrated television pro- 
gramming and corresponding related Internet infor- 
mation segments obtained from Web sites (62) on 

the Internet (20), the system comprising: 20 

first means (16, 114) for receiving program- 
ming, wherein the programming contains a 
video signal and an audio signal; 
second means (106) for receiving one or more 25 
uniform resource locators, wherein the uniform 
resource locators specify one or more Internet 
addresses (102) of the information segments 
which relate specifically to the content of the 
video and audio signals of the received pro- 30 
gramming; 

a controller (16), connected to the second 
receiving means (106), comprising: 
means (12) for decoding the uniform resource 
locators to determine the specified Internet 35 
addresses (1 02); 

means (98), connected to the decoding means 
(12), for retrieving the one or more Internet 
information segments residing at the deter- 
mined Internet addresses (102); and 40 
display means (18, 11 4), connected to the con- 
troller (16) and the first and second receiving 
means (16, 106, 114), for presenting the video 
and audio signals concurrently with the Internet 
information segments (102). 45 

2. A system as claimed in Claim 1 , further comprising: 

means (70, 74) for entering information at a 
member broadcaster Web site (62), including 50 
the uniform resource locators corresponding to 
a particular program and a time at which the 
particular program will be received by the first 
receiving means (16, 114); and 
means (70) for storing the entered information. 55 

3. A system as claimed in Claim 1 or Claim 2, further 
comprising: 



means (74) for sending the stored uniform 
resource locators at the time at which the par- 
ticular program will be received by the first 
receiving means (16, 114), directly over an 
Internet connection (94) to the second receiv- 
ing means (106). 

4. A system for presenting integrated television pro- 
gramming and corresponding related Internet infor- 
mation segments obtained from Web sites on the 
Internet (20), the system comprising: 

television broadcaster data entry and broad- 
cast means comprising: 

means (70, 74) for accessing a service Web 
site (62) on the Internet (20), wherein a mem- 
ber broadcaster of television programming 
accesses the service Web site (62); 
means (70, 74) for entering information into the 
service Web site (62), wherein the entered 
information is comprised of uniform resource 
locators and a time at which a particular pro- 
gram will be broadcast (86) by the member 
broadcaster (66), wherein the uniform resource 
locators specify one or more Internet 
addresses (102) of the relevant Internet infor- 
mation pages which relate specifically to the 
content of the particular program being broad- 
cast by the member broadcaster (66); 
means (70), connected to the entering means 
(70, 74), for storing the entered information; 
first means (86, 110) for sending the particular 
program being broadcast by the member 
broadcaster (66) to a user (118), wherein the 
particular program contains a video signal and 
an audio signal; 

second means (74), connected to the storing 
means (70), for sending, at the time at which 
the particular program will be broadcast, the 
stored uniform resource locators over a direct 
Internet connection (94) to the user (1 1 8); 
a user terminal (16) comprising: 
first means (16,11 4) for receiving, from the first 
sending means (86, 110), the particular pro- 
gram, including the video and audio signals, 
being broadcast by the member broadcaster 
(66) to a user (118); 

second means (106) for receiving, from the 
second means (74) for sending, the stored uni- 
form resource locators which correspond to the 
video and audio signals received by the first 
receiving means (16, 114); 
a controller (16), connected to the second 
receiving means (106), comprising: 
means (12) for decoding the uniform resource 
locators to determine the specified Internet 
addresses; 

means (98), connected to the decoding means 
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(12), for retrieving the one or more Internet 
information segments residing at the deter- 
mined Internet addresses (102); and 
display means (18, 11 4), connected to the con- 
troller (16) and the first and second receiving 5 
means (1 6, 1 06, 114), for presenting the video 
and audio signals concurrently with the Internet 
information segments. 

5. A system for presenting integrated television pro- 10 
gramming and corresponding related Internet infor- 
mation segments obtained from Web sites on the 
Internet (20), the system comprising: 

means (16) for receiving programming, 15 
wherein the programming contains a video sig- 
nal (36), an audio signal and one or more 
embedded uniform resource locators, wherein 
the embedded uniform resource locators spec- 
ify one or more Internet addresses of the infor- 20 
mation segments which relate specifically to 
the content of the video and audio signals of 
the programming; 

a controller (16), connected to the receiving 
means (16), comprising: 25 
means (12) for decoding the uniform resource 
locators to determine the specified Internet 
addresses; 

means (16), connected to the decoding means 
(12), for retrieving the one or more Internet 30 
information segments residing at the deter- 
mined Internet addresses; and 
display means (18), connected to the controller 
(16) and receiving means (16), for presenting 
the video and audio signals concurrently with 35 
the Internet information segments. 

6. A method for integrating television program content 
with relevant information pages from the Internet 
(20), the method comprising the steps of: 40 

receiving programming, the programming con- 
taining a video signal and an audio signal; 
receiving one or more uniform resource loca- 
tors, wherein the uniform resource locators 45 
specify one or more Internet addresses (102) 
of the relevant Internet information pages 
which relate specifically to the content of the 
video and audio signals of the programming; 
interpreting the uniform resource locators to so 
determine the specified Internet addresses; 
retrieving the one or more Internet information 
segments residing at the determined Internet 
addresses (102); and 

presenting the video and audio signals concur- 55 
rently with the Internet information segments. 

7. A method as claimed in Claim 6, further comprising 



the steps of: 

entering information at a member broadcaster 
Web site, including the uniform resource loca- 
tors corresponding to a particular program and 
a time at which the particular program will be 
received by a first receiving means (16, 114); 
and 

storing the entered information. 

8. A method as claimed in Claim 6 or Claim 7, further 
comprising the steps of: 

sending the stored uniform resource locators at 
the time at which the particular program will be 
received by the first receiving means (16, 1 14), 
directly over an Internet connection (94) to a 
second receiving means (106). 

9. A method for integrating television program content 
with relevant information pages from the Internet, 
the method comprising the steps of: 

receiving programming, the programming con- 
taining a video signal (36), an audio signal and 
one or more uniform resource locators, 
wherein the uniform resource locators are 
embedded in the video signal (36) and specify 
one or more Internet addresses of the relevant 
Internet information pages which relate specifi- 
cally to the content of the video and audio sig- 
nals of the programming; 
extracting the uniform resource locators from 
the video signal; 

interpreting the uniform resource locators to 
determine the specified Internet addresses; 
retrieving the one or more Internet information 
segments residing at the determined Internet 
addresses; and 

presenting the video and audio signals concur- 
rently with the Internet information segments. 



8 



EP 0 982 943 A2 



CONTENT 




URL 


CREATION 




ENCODER 



7 



FIG. 1 

8 



VIDEO 

WITH 

URLs 




SUBSCRIBER SITE 




16 



FIG. 2 

SYSTEM DESIGN 



CONTENT 
CREATION 



7 



URL 
ENCODER 




i 


VIC 
SIGI 


€0 
NAL 



18 




DISPLAY 




LOCAL 


MONITOR 




PC 



LOCAL 
PERSONAL 
COMPUTER 



DISPLAY 
MONITOR 



8 



4- 



32 



18 




9 



EP 0 982 943 A2 



GET URL 




YES 



r 



46 



CHECK FOR 
MISSPELLING 




ADD TO 
URL LIST 



[ L 



58 





SEND 


NETSCAPE 




GOTO 


COMMAND 


SOFTWARE DESIGN 




FIG. 


3 





EP 0 982 943 A2 




